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Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including tine fee set fortli 
in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
12/29/08 has been entered. 

Response to Arguments 

2. In view of applicant's arguments filed on 12/29/2008 Humbard reference is removed 
as prior art. 

Priority 

3. Applicant's claim for the benefit of a prior-filed application under 35 U.S.C. 1 19(e) or 
under 35 U.S.C. 120, 121, or 365(c) is acknowledged. Applicant has not complied 
with one or more conditions for receiving the benefit of an earlier filing date under 35 
U.S.C. 1 12 for claims 1-35 of this application. In particular, applicant claims priority 
to application 09/344,442 as a continuation-in-part, which claims priority to 
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application 09/361,470 as a continuation-in-part, further claims priority to application 
09/378,184 as a continuation-in-part, and further claims priority to application 
09/378,220 as a continuation-in-part. 

Application 09/378,220, now USPN 6,526,449, is the work of others. 

Furthermore, the disclosures of the above applications fail to disclose the subject 
matter claimed by applicants in the instant application. Specifically, the disclosures 
of these applications fail to disclose comparing contrast levels, brightness levels, 
or color saturation levels among the snapshots and determining the most 
presentable snapshot when the most presentable snapshot has a best 
contrast, a median brightness, or highest color saturation. 

Accordingly, applicants are denied the benefit of the 06/25/1999 filing date of CIP of 
application 09/344442, the 07/27/1999 filing date of CIP of application 09/361470, 
and the 08/20/1999 of CIP of application 09/378184, and the 08/19/1999 filing date 
of CIP of application 09/378220. 
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Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1 , 1 0-1 3, 1 7, 24-29, 31 , 40, 41 , 43, 44, and 46-51 are rejected under 35 

U.S.C. 103(a) as being unpatentable over Gosterhout et al., USPN 6,405,371 
(hereinafter "Gosterhout") in view of Cove et al., USPN 6,41 1 ,337 (hereinafter "Cove"). 

3. Regarding claim 1 , Gosterhout discloses a method comprising: 

providing a plurality of individual image areas in an EPG display (Fig. 

2); 

receiving a user selection corresponding to a selected channel (Fig. 
3, elements 300,301 ,302); 

detecting a video stream corresponding to the selected channel 

(upon selection of channel, 302, the corresponding stream is detected); 

capturing a plurality of snapshots snapshot from the video stream 
(video stream composed of plurality of l-frames, snapshots, which are captured 
and displayed on screen); 
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identifying a first snapshot from the plurality of snapshots captured 
from the video stream (the snapshot/frame received/detected); 

converting the first snapshot captured into a reduced image of real- 
time programming (Fig. 9, e.g. TF2); and 

displaying the reduced image of real-time programming in the first of 
the individual image areas (Fig. 9, lower portion of tlie full screen, image areas 
associated with the selected channels, reduced image may also be of reduced 
resolution, Col. 1, lines 64-67), wherein the reduced video image is 
associated with the selected channel (TF2, RTL4, CNN, BRT are reduced 
images presented on the screen). Col. 3, line 20, through Col.5, line 23. 

Oosterhout is silent on: 

displaying a graphical representation of a polyhedron, 
displaying the reduced image on a side of the graphical 

representation of the polyhedron 

However, Cove, in analogous art, discloses: 

displaying a graphical representation of a polyhedron(Figs. 2,6, and 

7). 

displaying the reduced image on a side of the graphical 
representation of the polyhedron (Fig. 6, video element). Col. 6, lines 52-61 



Application/Control Number: 1 0/072,1 1 4 Page 6 

Art Unit: 2421 

Therefore, it would liave been obvious to one of ordinary skill in the art, at the 
time of invention, to modify the system of Oosterhout with Cove's invention in 
order to enable the viewer to conveniently follow/monitor/navigate through 
multiple programs at the same time (as taught by Oosterhout Col. 1 , lines 31-35, 
and Cove Col.1, lines 39-55). 

Regarding claim 10, Oosterhout discloses wherein snapshot is filtered to 
change the display characteristics of the snapshot, Col. 4, lines 30-33. 

Regarding claim 12, Oosterhout discloses wherein snapshot is filtered by one 
of enhancing or reducing a contrast, Col. 4, lines 30-33. 

Regarding claim 13, Oosterhout discloses wherein snapshot is filtered by a 
one of enhancing or reducing color saturation. Col. 4, lines 30-33. 

Regarding claim 40, Oosterhout as modified by Cove further teaches displaying 
an additional reduced image corresponding to a different selected channel 
on a different side of the polyhedron, each side/surface is assigned to a 
function such as video selected by the user (Cove: Fig. 6, Col. 6, lines 52-61) 

Regarding claims 41 , Oosterhout as modified by Cove further teaches that 
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receiving a user request to rotate the polyhedron to display 
information corresponding to the different selected channel (Cove: Figs. 6, 
and 7; Col. 6, line 37 through Col. 7 line 58); and 

updating the EPG display by rotating the graphical representation of 
the polyhedron so that a greater portion of the polyhedron side 
corresponding to the different selected channel Is displayed in the first of 
the individual image areas (rotating the polyhedron to provide the viewer the 
face presenting the selected program/show of the channel, e.g. - Cove: Fig. 7A, 
"Exit" represents the largest viewable surface). 



Regarding claim 48, Oosterhout as modified by Cove further discloses: 

identifying a segment of the video stream (as taught by Oosterhout, 
programs are selected based on specified point of time, Col. 4, lines 49-56) 
corresponding to the selected channel (Channels are displayed in Fig. 7) 

converting the segment of the video stream to a reduced resolution 
video stream (Oosterhout, Fig. 7, TF2, which is subsequently selected and 
presented within the list of selected programs in Fig. 9); and 

displaying the reduced resolution video stream on the side of the 
graphical representation of the polyhedron in the first of the individual 
image areas (Cove: Fig. 6, video element). 
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4. Regarding claim 17, Oosterliout teaclies an apparatus comprising: 

a tuner (Fig. 1 , 22) configured to tune to a selected channel to receive 
a video stream (22, Col. 2, lines 58-67); 

a shutter function configured to capture a plurality snapshots from 
the video stream (capturing video frames at 22, MPEG decoding is 
accomplished by capturing frames of the transport stream, e.g. l-frames); 

an image improver (element 30 enables the system to distinguish 
viewer's selections from other available programs in the EPG, Col. 3, lines 11- 
17), configured to identify a first snapshot from the plurality of snapshots 
captured from the video stream (determining which video frames should be 
presented in a visual program summary , Fig. 2); and 

a display (24) configured to: 

display an EPG comprising a plurality of individual image 

areas (Fig. 2); 

and display the first snapshot in the first individual images 
area, wherein the first snapshot is associated with the selected 
channel (selected channel of Fig. 2, is highlighted as shown in Fig. 5, 45a. 
The final selection of programs is shown in Fig. 9, TF2, RTL4, CNN, and 
BRT). Col. 3, line 20, through Col.5, line 23. 
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Oosterhout is silent on: 

displaying a graphical representation of a polyhedron, 
displaying the reduced image on a side of the graphical 

representation of the polyhedron 

However, Cove, in analogous art, discloses: 

displaying a graphical representation of a polyhedron (Figs. 2,6, and 

n 

displaying the reduced image on a side of the graphical 
representation of the polyhedron (Fig. 6, video element). Col. 6, lines 52-61 

Therefore, it would have been obvious to one of ordinary skill in the art, at the 
time of invention, to modify the system of Oosterhout with Cove's invention in 
order to enable the viewer to conveniently follow/monitor/navigate through 
multiple programs at the same time (as taught by Oosterhout Col. 1 , lines 31-35, 
and Cove Col.1, lines 39-55). 

Regarding claim 24, Oosterhout discloses a filter to filter the display 
characteristics of the snapshot, Col. 4, lines 30-33. 

Regarding claim 26, Oosterhout discloses wherein filter enhances the 
snapshot contrast, Col. 4, lines 30-33. 
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Regarding claim 27, Oosterhout discloses wherein filter reduces the snapshot 
contrast, Col. 4, lines 30-33. 

Regarding claim 28, Oosterhout discloses wherein filter enhances the 
snapshot's color saturation, Col. 4, lines 30-33. 

Regarding claim 29, Oosterhout discloses wherein filter reduces the 
snapshot's color saturation, Col. 4, lines 30-33. 



Regarding claims 44, Oosterhout as modified by Cove further teaches that 

receiving a user request to rotate the polyhedron to display 
information corresponding to the different selected channel (Cove: Figs. 6, 
and 7; Col. 6, line 37 through Col. 7 line 58); and 

updating the EPG display by rotating the graphical representation of 
the polyhedron so that a greater portion of the polyhedron side 
corresponding to the different selected channel is displayed In the first of 
the individual image areas (rotating the polyhedron to provide the viewer the 
face presenting the selected program/show of the channel, e.g. - Cove: Fig. 7A, 
"Exit" represents the largest viewable surface). 
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Regarding claim 49, Oosterhout as modified by Cove further discloses: 

identifying a segment of the video stream (as taught by Oosterhout, 
programs are selected based on specified point of time. Col. 4, lines 49-56) 
corresponding to the selected channel (Channels are displayed in Fig. 7) 

converting the segment of the video stream to a reduced resolution 
video stream (Oosterhout, Fig. 7, TF2, which is subsequently selected and 
presented within the list of selected programs in Fig. 9); and 

displaying the reduced resolution video stream on the side of the 
graphical representation of the polyhedron in the first of the individual 
image areas (Cove: Fig. 6, video element). 



4. Computer code claims 31 , 46, 47, and 50 recite similar limitations of method claims 
1 , 40, 41 , and 48 respectively, and are rejected for the same reasons as addressed. 



5. Regarding claim 51 , Oosterhout teaches A method for displaying programming 
information in an electronic programming guide (Figs 2, and 9) comprising: 
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receiving at a television system a video stream corresponding to a 
plurality of television channels (Fig. 1 , plurality of channels, MPEG 1 1 .1 
throughl 1 .n is received at receiver 21 ); 

receiving a plurality of user selections, wherein each user selection 
identifies a television channel selected to be displayed within an electronic 
programming guide on the television system (user selection process is 
outlined in Fig.3. An interim view of user selection is illustrated in Fig. 7, and the 
final selected channels are shown in Fig. 9); 

capturing a plurality of snapshot images from the video stream 
(MPEG l-frames) based on the plurality of user selections, wherein the 
plurality of snapshot images comprises at least one video image from each 
of a plurality of current television programs playing on the plurality of 
selected television channels (capturing video frames from selected channels 
1 1 .1 through 1 1 .n, as displayed originally in Fig.2, and selected from to present 
Fig. 9); 

converting each of the plurality of snapshot images to reduced size 
thumbnail images (thumbnail/snapshots, for example Fig. 2, TF2); 

identifying the television channel associated with the geometric 
surface selected via the user input (thumbnail/snapshots are presented in 
reduced size geometric- two dimensional- squares, Fig. 9, e.g. TF2); 

creating an updated reduced sized thumbnail image based on the at 
least one video image from the identified television channel (thumbnails are 
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updated in real time or based on specific refresh rates; Col. 1, lines 64-67; Col. 4, 
lines 54-56); 



Oosterhout does not teach: 

displaying a first graphical representation of a 3-dimensional 
polyhedron within the electronic programming guide, wherein a plurality of 
geometric surfaces of the 3-dimensional polyhedron are simultaneously 
visible within the electronic programming guide, and wherein the plurality 
of visible geometric surfaces are rendered on different portions of the 
screen and have different sizes, and wherein the plurality of visible 
geometric surfaces are each rendered with a different lighting level based 
on the relative positions of the surfaces within the polyhedron; 

mapping each of the plurality of reduced size thumbnail images to 
distinct geometric surfaces of the 3-dimensional polyhedron; 

receiving user input via the electronic programming guide selecting 
one of the geometric surfaces of the 3-dimensional polyhedron; 

displaying a second graphical representation in which the 3- 
dimensional polyhedron is rotated within the electronic programming guide 
such that the geometric surface corresponding to the identified television 
channel is rendered in a larger portion of the screen than the 
corresponding surface in the first graphical representation. 
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However, Cove, in analogous art, discloses: 

displaying a first graphical representation of a 3-dimensional 

polyhedron (Figs. 2,6, and 7) within the electronic programming guide 

(Polyhedron is shown in Fig. 2, superimposed on a movie scene. Polyhedron 

representing various functions may be superimposed on demand on any window 

including the program guide), wherein a plurality of geometric surfaces of the 

3-dimensional polyhedron are simultaneously visible (Fig. 2, 59a, 59, etc.) 

within the electronic programming guide, and wherein the plurality of 

visible geometric surfaces are rendered on different portions of the screen 

and have different sizes (59a and 59 are in different positions and have 

different sizes), and wherein the plurality of visible geometric surfaces are 

each rendered with a different lighting level based on the relative positions 

of the surfaces within the polyhedron (59a, 59, and 52 have different lighting 

levels); 

mapping each of the plurality of reduced size thumbnail images to 
distinct geometric surfaces of the 3-dimensional polyhedron (various 

functions may be mapped to various surfaces of the polyhedron, e.g. Fig. 6, 
video element, TV plus element, each of which may be the mapping of a selected 
channel as taught by Oosterhout); 

receiving user input via the electronic programming guide selecting 
one of the geometric surfaces of the 3-dimensional polyhedron (polyhedron 
surfaces are selectable by the user. Col. 1 , lines 20- 27); 
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displaying a second graphical representation in which the 3- 
dimensional polyhedron is rotated within the electronic programming guide 
such that the geometric surface corresponding to the identified television 
channel is rendered in a larger portion of the screen than the 

corresponding surface in the first graphical representation (rotating tlie 
polylieciron to provide tine viewer tine face presenting tlie selected program/sliow 
of the channel, e.g. - Cove: Fig. 7A, "Exit" represents the largest viewable 
surface). 

Therefore, it would have been obvious to one of ordinary skill in the art, at the 
time of invention, to modify the system of Oosterhout with Cove's invention in 
order to enable the viewer to conveniently follow/monitor/navigate through 
multiple programs at the same time (as taught by Oosterhout Col. 1 , lines 31-35, 
and Cove Col.1, lines 39-55). 

6. Claims 7-9, 21-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Oosterhout in view of Cove, in further view of Toklu et al., USPN 6,549,643 
(hereinafter "Toklu"). 

The system of Oosterhout and Cove is silent on comparing contrast levels, 
brightness levels, or color saturation levels among the snapshots and 
determining the most presentable snapshot when the most presentable 
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snapshot has a best contrast, a median brightness, or highest color 
saturation. 

However, Toklu, in analogous art, discloses a method and system for accessing 
a collection of images (Fig. 2, Video in, element 11), and using a technical 
quality measure (15, 16, 17) to select the best key frame (l-frame, image, 
element 13), wherein the quality metric indicates the color, brightness, contrast of 
the image. (Col. 5, line 61 through Col. 6, line 7). The difference between frames 
via a pixel based frame difference analysis, or a color histogram analysis are 
reflective are contrast, brightness, and color saturation differences. 

Therefore, it would have been obvious to one of ordinary skill in the art, at the 
time of invention, to modify the system of Oosterhout and Cove with Toklu's 
invention in order to select the best image for the presentation on the EPG. 

Conclusions 

7. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure: 

> Miller et al., USPN 6,597,358: Miller discloses organizing three dimensional 
(polyhedrons) representation of various applications (e.g. streaming video). 
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whereby the user could allocate a particular group or category of applications to 
each respective cube to accomplish different tasks (see Figs. 7 and 8). 

> Wilf et al., WO 99/51 022: Wilf discloses a method of selecting Key-frames (from 
digital stream, e.g. MPEG l-frames, or digitized analog video) by comparing each 
frame in the video sequence with respect to its preceding and subsequent key 
frames, in order to determine the optimum key frame (Fig. 2) 

Contacts 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JAMES R. MARANDI whose telephone number is 
(571 )270-1843. The examiner can normally be reached on 8:00 AM- 5:00 PM M-F, 
EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 

supervisor, John W. Miller can be reached on (571) 272-7353. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Patent Application Information Retrieval (PAIR) system. Status information for 
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Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
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/John W. Miller/ 

Supervisory Patent Examiner, Art Unit 2421 
/James R. Marandi/ 
Examiner, Art Unit 2421 



